United States Patent and Trademark Ofhce 



UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark OtBce 

Address: COMMISSIONER FOR PATENTS 



APPLICATION NO. 



FILING DATE 



FIRST NAMED INVENTOR 



ATTORNEY DOCKET NO. CONFIRMATION NO. 



10/587,291 



04/13/2007 



85775 7590 10/29/2010 

Locke Lord BisseU & Liddell LLP 
Attn: IP Docketing 
Three World Financial Center 
New York, NY 10281-2101 



Kazunori Shimazaki 



KIM, HEE-YONG 



PAPER NUMBER 



NOTIFICATION DATE | DELIVERY MODE 
10/29/2010 ELECTRONIC 



Please find below and/or attached an Office communication concerning this application or proceeding. 

The time period for reply, if any, is set in the attached communication. 

Notice of the Office communication was sent electronically on above-indicated "Notification Date" to the 

following e-mail address(es): 

ptopatentcomniunication@IockeIord.com 



PTOL-90A (Rev. 04/07) 



KJtSiVrXS nvrliyjts OUff Iff fcff Jr 


Application No. 

10/587,291 


Applicant(s) 

SHIMAZAKI, KAZUNORI 


Examiner 
HEE-YONG KIM 


Art Unit 
2482 





- The MAILING DATE of this communication appears on the cover sheet with the correspondence address — 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
eamed patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )^ Responsive to communication(s) filed on 25 July 2005 . 
2a )□ This action is FINAL. 2b)|3 This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1.3-9 and 11-16 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) n Claim(s) is/are allowed. 

6) IEI Claim(s) 1.3-9 and 11-16 is/are rejected. 
/)□ Claim(s) is/are objected to. 

8) 0 Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10)^ The drawing(s) filed on 25 July 2005 is/are: a)^ accepted or b)^ objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held In abeyance. See 37 CFR 1.85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
11 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)S Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)^ All b)n Some * c)^ None of: 

1 Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attach ment(s) 

^ Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-413) 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. . 

El Information Disclosure Statement(s) (PTO/SB/08) 5) □ Notice of Informal Patent Application 

Paper No(s)/Mail Date 7/25/2006 and 2/2&2007 . 6) □ Other: . 

PTOL-326 (Rev. 08-06) Office Action Summary Part of Paper No./Mail Date 20101019 



Application/Control Number: 10/587,291 
Art Unit: 2482 



Page 2 



DETAILED ACTION 

1 . Claims 2 and 10 are cancelled. 

Claim Objections 

2. Claims 3 and 4 are objected to because of the following informalities: Claim 3 
depends on the cancelled claim 2. Claim 4 is depend on claim 3. Therefore they are 
objected. For the prosecution of the application, examiner interprets that claim 3 
depends on claim 2. 

Appropriate correction is required. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or deschbed as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the phor art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 1, 3-9, and 11-16 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Shimazaki (US 6,785,404) in view of Tanaka (US 6,201 ,882), 
hereafter referenced as Shimazaki and Tanaka respectively. 

Regarding claim 1, Shimazaki discloses Image Positional Relation Correction 
Apparatus Steering Supporting Apparatus Provided with the Image Positional Relation 
Correction Apparatus, and the Image Positional Relation Correction Method. 
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Specifically Shimazaki discloses An apparatus for correcting relative positional 
relationship between an actual video image captured by a camera and a virtual video 
image for use in a video image display device for superimposing the actual video image 
and the virtual video image on a monitor screen (Fig.1), comprising: 
actual targets set in an actual coordinate system (Coordinate values of road surface 
coordinate system, col. 8, line 59) in an area captured by the camera (Real Target by 
Camera Image, Fig.4); 

coordinate conversion means (Logic Drawing Circuit 31 , Fig.4) for theoretically deriving 
monitor coordinates in a monitor coordinate system on the monitor screen by coordinate 
conversion of actual coordinates of the actual targets in the actual coordinate system 
based on reference values of coordinate conversion parameters ( Equation at Col.8, line 
53) including internal parameters of the camera itself and attachment parameters for 
attaching the camera to the vehicle (eight parameters, col.8, line 58); 
recognition means for recognizing the monitor coordinates (Real Target by Camera 
Image, Fig.4) of the image of the actual targets actually captured by the camera; and 
correction means for correcting at least values of the internal parameters of the camera 
itself of the coordinate conversion parameters (Parameters are corrected by satisfying 
zero deviation between real and virtual points in monitor coordinate, col. 9, line 1-52) 
based on deviations ( ^n-^n', col.9, line 17 ) between the monitor coordinates of the 
image (^n', col.9, line 10-12) of the actual targets actually captured by the camera and 
the corresponding monitor coordinates (^n, col.8, line 61-65) in the monitor coordinate 
system of the actual targets which has been subjected to the coordinate conversion, 
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and correcting relative positional relationship (^n-^n-O, col.9, line 16-18 ) between the 
actual video image and the virtual video image based on the corrected values of the 
coordinate conversion parameters (parameters are set if ^n-^n-O, col.9, line 16-18), 
the correction means generating relational expressions the number of which is larger 
(Additional virtual targets R5, R6... may be used, col. 12, line 26-43, Examiner read it as 
normally 4 virtual targets can give 8 equations by generating x and y coordinates in 
each target, therefore more than 4 targets gives larger than number of parameters) than 
the number of the coordinate conversion parameters (8 parameters, col.8, line 58) 
based on the monitor coordinates of the image of the actual targets and the monitor 
coordinates in the monitor coordinate system of the actual targets which have been 
subjected to coordinate conversion; 

the number of actual targets being determined such that the number of the relational 
expressions is larger than the number of the coordinate conversion parameters 
(Additional virtual targets R5, R6.. may be used, col. 12, line 26-43, Examiner read it as 
normally 4 virtual targets can give 8 equations by generating x and y coordinates in 
each target, therefore more than 4 targets gives larger than number of parameters) 
which require correction, 

the recognition means providing a virtual target in the monitor coordinate system on the 
monitor screen based on the coordinate conversion parameters before modification ( 
Virtual Target by Logic Drawing, Fig.1) using the coordinate conversion means, and 
carrying out the recognition based on the difference (Monitor Screen, Fig.1 , shows 
difference) between the monitor coordinate of the image of the actual target captured 
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actually by the camera and the monitor coordinate of the virtual target. 
However, Shimazaki fails to disclose the coordinate conversion parameters being 
corrected such that the square-sum of the deviations is the minimum. 

In the analogous field of endeavor, Tanaka discloses Camera Calibration 
Apparatus. Tanaka specifically discloses the estimated parameters being corrected 
such that the square-sum of the deviations is the minimum (Co. 10, 18-21), in order to 
have the optimum parameters. 

Therefore, given this teaching, it would have been obvious to one of ordinary skill 
in the art at the time invention was made to modify Shimazaki by providing specifically 
the coordinate conversion parameters being corrected such that the square-sum of the 
deviations is the minimum, in order to have the optimum conversion parameters. The 
Shimazaki image positional relation correction apparatus, incorporating the Tanaka 
correcting estimated parameters such that the square-sum of the deviations is the 
minimum, has all the features of claim 1 . 

Regarding claim 3, Shimazaki and Tanaka disclose everything claimed as above 
(see claim 1). In addition, Shimazaki discloses wherein the recognition means includes 
a controller (controller (Up, Down, left, right arrows), Fig.7) for moving one of the actual 
target and the virtual target on the monitor screen to a position overlapped on the other 
of the actual target and the virtual target by manipulation of an operator. 

Regarding claim 4, Shimazaki and Tanaka disclose everything claimed as above 
(see claim 3). In addition, Shimazaki discloses wherein the controller includes direction 
buttons (controller (Up, Down, left, right arrows), Fig.7) for inputting a correction amount 
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of one of the actual target and the virtual target on the monitor screen in an up direction, 
a down direction, a left direction and a fight direction, a decision button for confirming a 
condition in which the actual target and the virtual target are overlapped with each 
other, and a calculation button (Calculation 66c, Fig. 7) for allowing the correction means 
to start correction calculation. 

Regarding claim 5, Shimazaki and Tanaka disclose everything claimed as above 
(see claim 1). In addition, Shimazaki discloses wherein the recognition means includes 
an image processing circuit ( Signal Processing IC 27 and Logic Drawing Circuit 61 and 
Superimposing Circuit 69, Fig. 7) for carrying out the recognition by Image processing. 

Regarding claim 6, Shimazaki and Tanaka disclose everything claimed as above 
(see claim 1). In addition, Shimazaki discloses wherein the actual video image and the 
virtual video image are a video image at the back (rear image, col.1, line 18-20) of the 
vehicle and a steering assist guide (steering supporting guide, col.1, line 18-20), 
respectively. 

Regarding claim 7, Shimazaki and Tanaka disclose everything claimed as above 
(see claim 6). In addition, Shimazaki discloses wherein the actual target is set on a road 
surface (data of vehicle rear view such as a road, col. 5, line 40-42). 

Regarding claim 8, Shimazaki and Tanaka disclose everything claimed as above 
(see claim 6). In addition, Shimazaki discloses wherein the actual target 
is set on a planar member attached to a rear portion of the vehicle (vehicle rear part 
bumper, col.5, line 40-42). 
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Regarding claim 9, tine claimed invention is a method claim corresponding to an 
apparatus claim 1 . Therefore, it is rejected for the same reason as claim 1 . 

Regarding claim 11, the claimed invention is a method claim corresponding to an 
apparatus claim 3. Therefore, it is rejected for the same reason as claim 3. 

Regarding claim 12, the claimed invention is a method claim corresponding to an 
apparatus claim 5. Therefore, it is rejected for the same reason as claim 5. 

Regarding claim 13, Shimazaki and Tanaka disclose everything claimed as 
above (see claim 1). Shimazaki further teaches wherein the recognition means 
automatically recognizes the nearest actual target to the virtual target without displaying 
the virtual target (because the pair of the nearest actual target and the virtual target 
should be recognized in order to calculate the deviation of coordinates. Also it was 
obvious to calculate nearest actual target to the virtual target since both coordinates are 
known, col. 8-9). 

Regarding claim 14, Shimazaki and Tanaka disclose everything claimed as 
above (see claim 1 ). Shimazaki further teaches wherein the correction means calculates 
lines extending between new virtual targets based on the coordinate conversion 
parameters after modification, the lines being displayed on the monitor screen (solid 
lines and dotted lines of rectangles, Fig.9). 

Regarding claim 15, the claimed invention is a method claim corresponding to an 
apparatus claim 13. Therefore, it is rejected for the same reason as claim 13. 

Regarding claim 16, the claimed invention is a method claim corresponding to an 
apparatus claim 14. Therefore, it is rejected for the same reason as claim 14. 
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Conclusion 

5. Any inquiry concerning tliis communication or earlier communications from tine 
examiner should be directed to HEE-YONG KIM whose telephone number Is (571)270- 
3669. The examiner can normally be reached on Monday-Thursday, 8:00am-5pm EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Marsha Banks-Harold can be reached on 571-272-7905. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 

Patent Application Information Retrieval (PAIR) system. Status information for 

published applications may be obtained from either Private PAIR or Public PAIR. 

Status information for unpublished applications is available through Private PAIR only. 

For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 

you have questions on access to the Private PAIR system, contact the Electronic 

Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 

USPTO Customer Service Representative or access to the automated information 

system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/HEE-YONG KIM/ 
Examiner, Art Unit 2621 



/Andy S. Rao/ 

Primary Examiner, Art Unit 2482 
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